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abstract particular teaching perCoriaaaee is limited by 

fima and nlace and must be regarded as only a ismall sample of the 
laT-ge collection of activities called teaching, 

teaching but it nay also be a separate activity carried on by a 
third pLtv= Evaluation methods differ according to , 

whethel for guidance of preservice teachers, 

programs, or certification. For both teacher educatip_ and teacher 
certification a major problem is that of defining all the kinds of 
jobs that teachers are expectad 

Social and institutional settings in which the jobs exist,, ho lariier 

what the main reason for the evaluation of a J®|S^J|acher 

nerformarice. tM© evaluator must take soae account of what the teacher 
accS^aplish. I£ teachlns perfor.ance is ir be avalaatei 
in detail some theory of teaching is needed as a guiie^to ho 
sLufd ie broken down: Adeguate justiflcati^ for the^ theory must ne 
available in soae fora. * 

evaluating teaching performance that of^gathsring sif^ic„ea* 
accurate data. If teaching perf or aance is to>e Judg^ sources 

of pupil learning, great care must be eliaina.e 

of error in the assessment of learning i Among the ®^®y 

to the piobXe. of etaleitina. tocher petforjaDoa »'?, 

teacher selection, merit rating, accountability, ai«erentiatea 

staffing, and coBaunltycoatrol of the schools, {RT> 
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performance evaluation in relation to teacher education 

AND TEACHER CERTIFICATION 



gimimarv of the Salient Points 

Because this paper examines aspects of the problem of 
evaluating teaching performance in some depth, a sutmnary of 
some of the more salient points Is here provldsd for con- 
venlenea, • • 

1, Any particular teaching perfoinnance is limited by time 
and place and other aspects of the ittHnediate situation 
and must be regarded as only a small sample of the large 
collection of activities called teaching , which have 
direct or Indirect effects oii learning . 



2. Evaluation , which involves defining or reviewing objec- 
tives, examination of experience, and making value judg- 
ments based jointly on objectives and Information about 
experien'ee, is part of teaching | but it may also be a 
' separate activity . carried on by a third party for pur- 
poses other than those belonging strictly to the teach- 
ing activity itself. Evaluation methods will differ ac- 
eordlng to its purposes, whether for guidance of teachers 
4T«=pj'eparation, improvament of traxnlng programs, or cer- 
tification. 



3. For both teacher education and teacher certification a 
major preliminary problem is that of defining all the 
kinds of Jobs that teachers are expected to fill and 
adequately describing the social and institutional set- 
tings in which the Jobs exist or will (or should) exist 
In the future. 



4 . 




No matter what the main reason for the evaluation of a 
particular teaching performance, the evaluator must take 
some aecount of what the teachiir is trying to 
So far as possible the evaluatiir must put thia^ps=&l*tf^^ 

of ''behavioral objectives," iJtthe tta^^eifeaS^ alrea^ 

done so, and where this is deal with 

the problem of how to li^ 

ments of purpos©^^^^,Ja«^^es m change and therefor the _ 
evaluator to see whether earlier statements of 

oh still apply ^ ^ ^ — 




If teachinf performance la to he eyaluated iii detail some 
theory of teaching is need a guide as to how it should 

be broken down into its -parts. The theoiy should show 
which parts are most important and why apd how the parts 
combine to produce the’ result. Adequate justification for 
tjjg theory must be available , in some, foxiii, the. 
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reasoning behind it should support the cone Xus Ion that 
the entire procedure is sensible and either necess ry 
definitely beneficial, 

A particularly difficult problem in evaluating teaching 
performance is that of gathering sufficient accurate- 
data, pertinent to the purposes of the evaluation 
free from the Influence of factors over which the teacher 
could not be expected to have any control, if teaching 
performaace Is to be Judged on the basis of pupil learn- 
ing, great care must be used to eliminate major sources 
of error in the assessment of learning, Anong the maj 
soiffces of error are inadequate or poorly 
pllng and Insufficient control over the conditions under 
■which information is obtained. Instrxunents that have 
been developed and might be used in evaluation of teach- 
ing. performance are discussed in another paper. 

Among the many issues related to the problem of evalua- 
ting teaching performance are: racial bias In the selec 

tion of teachers, merit rating as applied to teachers, _ 
the aceotmtability of persons and institutions ior their 
educational effeetiveness, the pros and cons of differen- 
tial staffing of . the schools, and the Issue of coot^^- 
control of the schools™ 





Although ^te^her'^ucat ion and teacher eertlflcatlon are obviously dif 
J^^^^rioiieally distinct, and ser^/e purposes that are generally well 
tmderstood, their mutual interdependence and the diversity of procedures 
that they employ often lead to confusioa In dlseusslons about them. Both 
are now in trahsltion, under the coi^tned i^aet of 

the avalltbllity of new major; r and hence propositions about them 

that ^ca could be taken for granted^^^ ^ no won- 

der, then, that the 

the language changes also: new and ne^ 

come popular and other words and phrases , fade away . . Sanantlc difficulties 
tend to. become a serious problem for those who are attempting to deal with 
real needs In real situations on one hand and to co^nleate affectiyely 
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about them^Ofl.the other. , In those tlrc.mstancas, it babooves u^^ to be os 

explicit arpos^lbie'about the meanings of the terms we nee and about the 

assOTip^ions "Wb SsX© ni^lciiig# ■ „ , . . 

in thereections rhat follow.we ahall first . consider the terminology 
currently being used 'in dldcuselon 'of teacher edncatlcn and certification, 

attempt to cidenti^' the problems that are :lAerent in the evaluation of 
prtfoi^nce;'lffer;th«'we:Aall M 

the relateSalsuesSaa^er'^ “ 

_aepa*atriSer'‘thratate'of'thrart^ln inst™ pertinent to per- 

formanee evaluation will: be -discaased.^ _ V I c- i- 



txc: 



TT^:"g^A^« !ftPlnitions of te r ms and exploration of eonegpt 

c^l'~zl: ; to ^ich they refer 

The indisputable fact of large-scale failure of schools to 



learning in their pupils at an at«ptible rate h« 

Ctoiolhargi'Silieii'^th 

lt7efcc«ors' genkially hike a^ked ihat,' iatever the 



«kcher ikco^etence is viry 'common'kk.d that drastic 

lie -ieded^" ich'efSn^^'th« 

Srt of teaS^iSi^ 

W-'kni ■■cU.'etency-bashd teaci.er certification" are currently «ich in 

t£ sai''meaiW; .Wt inyc'urrent^edi^^^^^^ 

Ik^enCe ' is ti» smnS'^^ 

c^pWiVt^/ok "atiwerlny al^^^ reyukreieits: " It ikSues ,»allflcatlon 

by experience; anitra^ 
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pefi-sonal fitness for It* Competency is used to refer to some particular 

element of competence. Contemporary vriters often analyse teaching into 

* 

specific tasks and use competen cy to refer to the capability, Including 
perhaps a, whole set of skills^ necessary to the performance of a given 
task. 

The concept of competenee Is, of course, not new and one of the seman- 
tic problems that arise comes from earlier usage and earlier ideas of how 
the fact of competence might be established. Historically , teaching com- 
petence has been Inferred from such evidence as testimonials, letters of 
reference, transcripts of school records, degrees ur diplomas, personality 
assessment, and cognitive tests and measurenients • The current tendency is 
to rule out all such evidence and to depend solely on evidence derived 
from two sources. (15 evaluation of performance in real or realistic sit- 
uations, and (2) inference from evidence of learning on the part of persons 
taught (Del Schalock, 1970). There is, however, a problem connected with 
the newer usage, While common sense woul*: suggest that it must be easy to 
show that teacher competenee has a major impact on pupil learning, the evi- 
dence of it £r« 3 m research is not abundant and, in particular, it lacks 
elarlty and consistency across broad classes of teaching-learning situa- 
tions (Flanders ahd Simon, 1969). The current eoncept of teacher compe- 
tencs depends more strongly on faith that its connections with pupll leam— 
Irig will be established by future research than on results already in hand 

from past research, V ^ 

The ftftnruaetltms between teachlnE competence and teaching performahce 



also need to be considered. Teaching c ompetenee , as such, is not directly 
observable but is generally regarded as a more or less enduring personal , 
. character is tic I r a spec-iflc teaching competency , too, is 'prefui^^ 




persistent and hanee applicable to a vhole series of slmiiar situations 
within the limitations of Its definition. A performance, however, 

the observable manlfestatton of teaehing eompetence, or eon^eteney, is 
bound by time and place and other general situational variables, ^rfileh de- 
fine Its setting or context. Thus it provides an available test from 
which future perfo^iance to similar situations may be predicted, but no 
one performance or brief series of performances really talces the full 
measure of the eompetence or competency. That can only be determined in 
retrospect. Thus the term teachlna performance , as we shall use it here, 
refers to a particular sample of the general class of activities called 
teachlna without implying anything about the adequacy or representativenes 
of the mamplB. The schematic dlairam in Fig. 1 illustrates these rela- 
tionships. The solid arrows in the diagram signify causality, Pereas the 




Tjrofeen arrows slirnify definition or inference. Twuporal sequence from 
left to ri#it is itnpUed. The broken tines surrounding the boxes contain- 
ing teaching performance represent the external context defined by what 
we are here caUing general aitu atlonal variables. The latter refer to 
the terms of reference for a teaching- learning situation as a whole, such 
as the institutional setting, the relatively fixed features of the physi- 
cal surroundings, etc., as distinguished £r<^ "conditions of learning- 
subject to the teacher’s imnediate control. Generally the terms of refer- 
ence, taken together over a period of time, are thought of by the practic- 
ing teaching as a particular teaching assignment, but for analytical pur- 
poses, they may be more narrowly drawn and used to define a teaching task 
.-in which case, according to our previous definitions, "coi^etence" would 

become "competency." 

: . Any evaluaition of teaching performance must begin with some coneept of 

teaching, and evaluations based on radically different concepts may have 

little in common. Since teaching and related concept, leSffiiaB. are the 

subjects of several ht^ly ’developed theoretical systems, however, it would 

not be useful here to restrict either of them to a single arbitrary defini- 
tion. Inasmurfv as the conceptuallaation of teaching is one of the inherent 
pr«d)l^s ^ performance evaluatlpn, it will be discussed more fully in a 
liter section. ' Meaw^ile. a few very general propositions about 

nasd to t# considersd. 

,..^ 4 .. . Illi. co^ewce, is lnfertea fcom ^rformanc, not being 

direo«y obseCT»bU Itself; tot since leernl.^ tallies change 

op««t of , PM new behavior potential derived : from enpet^ 

' be^^demonstrated by a co4'»rlson of .or: Mre^^p^^ 

Itirner. • (Sometimee, however, it Is Inferred from a single performance 
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together with certain antecedent conditions and events, on the basrs of an 
illicit ,'or explicit as simp t ion of zero potantiallty. for - the perfonnance 
in qaestiem at some earlier time. ) .The pupil, performances in question 
imply, of course, contexts of the ir own, whi ch are defined by what we will 
Here .call pupil situational variables . .. They provide the terns of reference 
for .those observable behaviors fronv which learning is inferred. We note in 
^tssing that .the- term teaching does not enter into the_ above definition of 
Ijeaming ,.. althou^ .we. are here concerned prlinarily with learning that can 
b#. jattributed to, teaching. ^ ttl&^rather; gross account of the. circimstances 
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'First Occasion 



d LT "uiSccond Occasion 



that ^erally cpnsti^e:,the >asis ^fpr, Inferring : the ;0cci^r^ of learn- 
Ingrrit dOas nOt pretend _tq be -a eq^lete .description- Illustrated by 
diagram Fig. . .z~:r. rr'.'T 
dg iig ti<W rettim to -teaching _and consider .a -general - analysis , conipat- 
ible, it is hoped, with several different theories of the teaching- learning 






process, for the sake of clarity in the discussion of evaluation of teach- 
ing' performance that will follow. Many concepts of teaching have emeried 
over the ages, but contemporary thought h&s been profoundly influenced by 
thirbehaviorist viewpoint in psychology with its Insistent emphasis on de* 
acrlption ofT operations and of observabla conditions and events (S. ,i.th et 
alii i' 1969). In contenroorarv writing teaching appears to refer to a large 
eoliicfcion- of observable behaviors having direct or indirect effects on 



leafhihs ; (Sometimes if is defined to include behaviors merely intended 
to "have* effects on learning; it usually lilies purposeful activity, which 
will be~ discussed further on.) The concept of teaching as "intervention," 
lsnplyingithat_ learning may occur without it, is also current. Frcmi learn- 
ing theories' the concept of teaching has' acquired the further connotations 
of being concerned with dupII learning behavior and of involving inanlpula- 
tieifbf conditions of learning . What is here called nupll leamlng_behaY* 

^ is distinct from the term pupil perforinance , %Aich was used to denote 
the antecedent or subsequent series of pupil , behaviors (e.g.. In testing 
situations)' irom ^ieh the ocsurrenee of learning could be defected* Be- 
cause overt and hence observable, it is also 

dlAlnct. from leaming itself, which is not directly observable. 

pj^^TinXly teaching has been defined to include an evaluative function, 

Hany coaten^orary writers sea evaluation as part and parcel of the teachlng- 
leamlng process (Bums et al. , 1956); Hc^ separate role of ^’eval- 

uator" Is sometimes reeogalaed and from this some cc^uslon may arise. 
Because of the general concern about teaching and learning as matters per- 
tinent to the public interest, and especially because of the pervasive 
feeling that they are not proceeding satisfactorily, many persons other 
than teachers have sought to determine for themsfjlves what learning' was 
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"taklng place". Thus the third-part concept o£ the evaluator emerged and a 
‘'iet oV behaviorV^a^^ the' role 'of the outaide evaluator, closely 

akin to "the evVluarion''£unct-ion' in'^ came to be recogniged thcugh 

"'not alto'gether consistently. The' inter^^^ and eiternal forms o£ evalua- 
" ti^on need to V* "'dl¥t& more clearly 'as to their uses and the eircmi- 

^'stances of theiV'^cli^rr'enhe, evifi'thhu^^^ 

cclitr.tir!' :r c: =- arvi; : * l=’,-.£vi:r£ h.'vi.r i’ dir'^t cr ; 

different . 

— to teaching' ii generally understood to 

- - -- r - , - . ' 

^'iSIKdl'ipe^iffcatMi objehtiver (purposes) , ' examination of experience 
llmi ^ 5 f ^adte^Ait^ ^c^dltiohs; ^e^ninr Actions , ' subsequent condi- 

|5^turitid‘6huie-atf#-'tfftee^^ value judgments based 

^dn Che tnfofiMticn "ohtafhed and on' the specific When 

Soieir as a 'i 6 m#onent o'f Tihe totar temihg-leafh^^ eval- 

®ieii“aa*bhe 'c^ of ^ persona Involved. . . In sote accoimts It 
iifs^reitidpriiiifny as-t^ teacAeffs function, but others emphasise mutual 
te%mf - ahd= pbpll -evaluatlpri. 'f esponVlblti^^^^^ suggest exploration of 

= i-^eirtent^bf cdftespondetice between ^teacher and pupil purposes. Thd im.- 

poiht for thi present dlsdiKslon Is that control . over the information 

for evatuatioff 'rests with: the teacher or with 
thtf'tWaeheflaod bhe p^^ "The condltionB, events, and behaviors that 

"^■cbrfi^tltuTre"^^^ fnfbfmat ion ; base : may inot rbe rrecorded— they may merely be . - ; 
l£Waerve-d and reniatt*ared--but explicit ^ of objectives, examina- 

uittibn^of experiences: and formation-of^ v^^ basis of both, 

lerttatrammeled b^r anyu outside ’inter ference,^^^^^ judgments 

tirthat :^e:;-ther products: of this^kind:pfrevalllation.M to the teacher 

^ and pupil(s) in deciding their further strategies for teaching 

i log, resi 
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The evaluation conducted by a third party, perhaps ah outside evalua- 
tor, is similar in its processes and requires the same baoic kinds o£ in- 
formation, but typically employs more rigorous proc.^daras and applies more 
stringent criteria of knowing. Toward this end the .valuator may attempt 
to extend his control, in particular, over the sittiatlonal variably 

that define the contexts for pupil per formance from which learning may be 
Inferred. In practice this may represent only a small Incursion into the 
realm of teaching and may serve the teacher's purposes wall, but the pos- 
sibility of conflict between the teacher's and the evaluator’s purposes is 
Inherent In the social roles typically iisslfned to each. Frequently, when ^ 
the evaluation Is to be conducted In a school setting rather than in a 
laboratory, the solution with respect to control of information processes ■ 
is to provide for an additional set of pupil performances, external to 
those included in teaching, and place them under the evaluator's Jurisdic- 
tion. If that Is done the lnformat;ion about pupil learning known to the 
evaluator is apt to be more detailed and precise than that ordinarily taiown 
to the teacher, but it may fail to include data pertinent to soma of the 
teacher’s objectives. Since the Informatlcm sought by the evaluator de- 
pends on the purposes of the evaluation, ' these must be considered next. 

we are not here concerned with all possible purposes of evaluation of 
teaching, but. only with thoBe that pertain to teacher preparation and 

teacher certification, which appear to be reducible to three: 

1. For guidance of prospective teachers within the preparation 

program, i.e., formative evaluation with respect to Individuals. 

■ 2^ For guidance of teacher educators in program de^ 

modification, l.e. .fori^tlve evaluation with respect to pro- 

grms, curricula, component activitlfis, etc., in preparation 

for teachlhg. ■■ -i-’ r,'" . 
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3,. For teacher certification. ■ 

i?hile evaluation for the first two nuigo^es can be viewed as internal to 
the teaching situation where^ih the teacher educator is the ’'teacher” and 
the prospective tnacher is the ’Ipupll” they are clearly external to the 
prospective teacher's own teaching assignment in a laboratory or practxce 
teaching situation. Here the teacher educator, or someone else, assumes the 
third-party role of evaluator and the evaluation methods more nearly resera- 
hie those of external evaluation than the more casual methods typically 
pied by school teachers within the teaching process. Evaluation for teacher 
dirtification is always a third-party activity by reason of the accepted 
institutions, laws, and customs of our society. Logically it could hardly 
5e dthex’wise, for there Is nothing inherent in teaching that would regular- 
iP Provide all the information needed for decision-making about certifi- 
cation. , - ' . 

''■Referring back to the earlier diagrams, it may, be noted, that, assuming 
ihifd-party evaluation, the sehena presented in Fig. ,1 provides a rationale 
6f teacher certification. With minor modification the schema in Fig. 2 
provides a general model for the evaluation of any factor that affects 
iiaming. ‘ 

III. Problems Inherent In evaluation of teachi n g perffoCT^n^^ 

-S'-'*' - ' ■“ " :■ 

, ' for purposes of teacher nreparation and eertlficati on 

Both teacher preparation and teacher certification requi^^ some overview 
■ of the social stimcture within yrtiich the future 'teacher^ find ^floyment 

«id clear definitions of tide r#qulremi»nts of the poslticms in 
wi^ be placed. Tn truth, the word teacher is misleading lecause there are 
many kinds of teachers, some imieh more spee^^i^^ than others, and good 

prcparatlbn f or one kind of teaching position may be grossly Inadequate for 
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another. Beyond this preliminary problem are a series of others having to 
do Trf.th pu^ose8 of teaching, with theory of the teachlng-leariiing process, 
with 'experimental control of factors other than teaching which affect leam- 
ing outcomes, and with practical difficulties In the execution of evalua- 
tion progra^ however well designed. These all have a bearing on the ultl- 
uate validity of the judgments and decisions derived from evaluation of 
teaching performane# and applied to guidance of the prospective teacher, 
development and improvement of programs of preparation, or teacher certifi- 
cation. The overarching problem may be conceived as that of establishing 



-jsrsi b" £;r.cr. 



validity in all phases of evaluation for each of tiiese purposes. 

i.. ' ’ ' ‘ ' 









1 . ii yrob-definltlbh - . - o:jr eoc:,':::/, , 

bexs-fehe 1Jniteci‘St&tes prir&ipar responaibility for - teacher preparstloh 
* 

and "eertiflcation' is vested^ in‘ state educatlorial agencies and hence, histori 
callyi'the kinds of teaching assignments that have developed In practice 



have heeh- conf imed and legitlralzed by such agencies (Stinnett, 1969). Eie 
llits' of" job titles' provide tmpoct“ant“ clues bo the kinds of assigments a 
glv^'fersQn mght be eappected to undertake,' '(In New York State 57 differ- 
ent-titles are ii'stedT, "some” with' subclass’lflcatldns, ) A study of the job 



specifications for each position within some major jurisdiction, such as 
a state, .would, be a useful toward realistic ^deftoltlon of^ Ae^pneral 

situational variables for various kinds of teachlni. For the practicing 
teacher . these condlt Ipna Are tj^lcaXly ^ ^ss ocia ted acceptance^ of a job , 

and ^Include, speeliitatlon 



il^a jar tleular.- area la. a particular school) , -the nature of the group to 
be^tau^t,_ the contmt: «eas^^ i^ be rhspcmslols,. . ^ 



the available for teaching, the salary schedule, etc. Because these 
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conditlons are insCltutional , the individual teacher--especlally the be- 
giimer-generally has to accept them as data, i.e., given conditions not 
readily subject to his control. While the planner for the future need not 
accept existing Institutions as being iiranutable, he does need to have a 
good picture of what they are. 

Althou^i the types of teaching aoslgnment for which prospective teach- 
ers are to he prepared and for which certification requirements are estab- 
llshed may be clearly defined at a given time, they are not static in his- 
torical perspective (Andrews, 1970 1 Bruhacker, 1947). A particular defini- 
tion of job requirements may become obsolete, and hence the performance- 
based determination of con^«etenee, though valid at one time, may become 
Inapplicable under new conditions, The problem this poses for the evalua- 
tor is that of deciding whether a given narrowly defined set of general 
situational variables is sufficiently stable to Justify the effort and ex- 
pense of basing a performance evaluation on them. The more broadly defined 
the job the less likely it is rapidly to become obsolete, but the subtle 
problems of gradual obsolescence affect even the jobs of generalists. The 
logical eencluslons from these considerations In terms of teacher prepara- 
tion and certification are; (a) preparation for a ehanslng job must be a 
continual affair, and the performance criteria upon which preparation is 
based must themselves be subject to periodic review; (b) certification of 
specified kinds of teaching competence cannot in honesty promise the future 
relevance of that CGB^etence over a long term, as a lifetime teach^ eertl- 
ficatlon would appear to do. 

itolle it is use present patterns of job specif i^tlons. 

and the changes that are taking place In them, clarity about the desirable 
directions of social change is also needed. Oiie aspect of the evaluator's 
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problem, therefore, is to coviceptualite the entire sat of teaching posi- 
tions in some appropriate jurisdiction as they ought to be defined within 
some reasonable reality constraints. A basic issue is.l£hat of degree of 
specialization within the field of teaching. At highest level of gen- 
erality (lowest degree of specialization) one might conceive of an "all- 
purpose teacher" qualified to teach any. or all subjects at any level to 
pupils of any ehaiacterlstics and social origins in any kind of educatioii- . 
al environment. Though such versatility of teaching competence may appear 
ridictilQus and unlikely to occur in actual practice, this teacher general- 
ist definition is often approKlmated in the breadth of teaching competence^ 
estpeeted of the elementary school teacher and written into certification 
requirements. It seems likely that If flimsy evidence of competence were 
to he rejected, it would soon be apparent that the expectation of such a 
broad array of competencies in persons to be assigned to relatively low- 
ranking and low-paid positions was unrealistic. Either the teacher- 
generalist concept should be retained, in the institutional pattern envis- 
aged for the future,' and training and eompensation should be adjusted up- 
ward in view of the diversity of. demonstrated teaching competencies required 
of him, or else greater specialization among teachers of lower status should 

be considered. The low-paid generalist, expected to be all things to all 
men in all circimstances, can hardly fail to be accused of Incompetence in 
nany of the situations in %*ich he may be placed, even thou^ he have; 

a very respectable Veoi^etence which is not belni called upon. At present 
high degrees of teacher specialization are most typical at the secondary 
advanced levels and especially, in vocational fields. . 
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2 ^ Purposes j o f Teachirig - -''v i'-v- 

- ; . After the ' teaching positions within ^ich^,t^^^ co^eten-^^ , ; 

cles will come into play have been adequately conceived in the social- , - 
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Institutional sense a second problem arises — ^that of Identifying and de- 
ftnlng the purposes of teaching In the contexts in question. General 
teaching aims and purposes are strongly associated ^srtth the philosophic 
orientation of the persons or groups define them and expressions of 

th^ in educational literature are not hard to find (Annaonsp 1969). But 



their application to specific teaching assignments may not be explicit 
saou^ to guide an evaluation. And purposes are constantly in transition. 
This results in different and changing snEdiaaes among such outcomes of the 
teaching- learning process as motor skills* factual Information, verbal 
communleatlott skills, interests, esthetic appreciation and creativity. 



social conformlfty or nonconformity, critical thinking, and values or sys- 
fe #gma o£ belief- 

the definition of teaching purposes an issue arises with respect to 
*»b^ 3 vioral'^ statement. The translation of statements of teaching purpose 
Into ’Tjehaviorally stated objeetives" is essential • to systenvatlc and rigor- 
ous evaluation. Though evaluation in terms of more vaguely stated objee- 
tlvas is possibls. It is likely to be Impressionistic and subjective. It 
may depend ^ haphazard soinrces of information and thus be unverlflable. 

There are people, however, who object to the requirement that all teaching 
purposes must be put Into the form of behayloral objectives on the grounds 
that It distorts those alms of teaching tdiat refet more to inward • 

perience of the pupil than to his behavior. Th^ effort to force all pur- 
poses of teachlnr inth a accorWng to s^^^ba an im- 

possible exercise which is not In the best interest of educati^ in general 
C^rews, 1969). The problem for the valuator is tc. decae Aether or 
not to Include forn^ of evaluation that are Impressloplstlr. , 

f„l repilcabillty as'''Well as'lthos^ rl|srous;i:^;-.oh^ 
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rne purpoges of teaching may at times come into conflict with chose of 
evaluation. Observation procedures essential to an evaluation may, for 



eKsmple, introduce pupil or teacher anxieties that are inimical to the de- 
velopment of desirable attitudes and behaviors. Creative expression in 
particular imiy be stifled by an evaluative frame of reference. Such con- 
flicts may give rise to hostility between evaluator and teacher, especially 
when the roles are assigned to different people who have not fully under- 
stood and accepted each other's purposes. The challenge to the evaluator 
-is to devise a way of accomplishing his own purposes without interfering 
with the acconiplishmant of those of tha teacher. 

A conceptual difficulty with regard to purposes of teaching is Inherent 



In the question of whether to consider them as part of the external context 
or as part of the process of teaching. If one thinks of the purposes as 
being speially determined, in the main, and of the teacher as accepting 
the goal orientations of the surrounding eomnunity, acting, as an agent of 
society in the education of its children, then one should presumably place 
purposes of teaching among the general slttaational variables that define 
the teacher's assignment. Some schools and some conraiunities have a clearly 
Identifiable philosophic climate in tdiich expectations as to the emphases 

that teachers- will place on various kinds of learning outcemes are explicit. 

But it is generally not true that purposes are merely given as an externa^— 

reality to be sccepted, for the teacher can influence th^ and so can the 
-learner, if on# coixcades that they-have an Impo^^^ learning 

and also regards ;them as modifiable, is led to placa^^ the , _ 

conditions of learnini. From this point of vlp such to activity as pupll- 
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different kinds of statements abotit teaching purposes might be included in 
both sets of variables with provision for systematic comparison so as to 
avoid contradictions. In any case the evaluator’s problem, whether or not 
he is a third party, is to define objectives for use in evaluation which 
not only represent the expectations that others hold for the teacher and 
pupil but also sufficiently take into account the modifications of purpose 
that may grow out of the teaching* learning process itselr.^ At the very 
least the evaluator needs to check from time to time the continuing valid- 
ity of an original statement of purposes formulated, perhaps, some time in 
the past. There is also the possibility that retrospective evaluation may 
sometimes be needed based on purposes that have newly emerged. 



The demands that evaluation makes upon teaching theory and learning 
theory, once the purposes of teaching have been defined, depend on the pur- 
poses of the evaluationi When the evaluation is intended to serve the needs 
of teachers- In-preparatlon for individual guidance . or the needs of teacher 
educators for insists cOTicerning program development, detailed analysis of 
teaching performance is iniportant.^ v^^ a need to identify coi^onent 

parts and often it may be useful to fotews on one part at a time. A theory 

provides the power 'to explain 'practice teaching, for instance, in tenus of 

g'ije jeiisons for the results ’obtained and hence to direct learner’s and 
teacher* s efforts to the particular aspects of performance most needing 
their attention. . . - 

'r. r". -rr', ■■■ ' ... ■ ■ ' 

Iflien the taaching-lea.rnLng process is treated analytically, the ^valu- 
ator 'Wi.s; the problem, of jusH^ the theory on i^ichlfhe analysis is 

based: If established theoi-y Is invoked, presumably a body of research . 



V. ■ ■■■ :’r-- ■ , -/'r:'-'’ ■■'.i '• _ ;= ,7 .. . 

I based cin it inay be drawn , upon.. Each , conipoheiit of ■teaching, however defined 
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^atever its postulated relationship to other eonffioneiitSj nrust have 
de:£ftOTiatrable -/alidlty In Its owm right if it Is to be eonsldered as a sep- 
arate eluent of the teaching perforniaiice subjected to evaluation. Compo- 
nents that are not directly observable require evidence of construct valid- 
ity— that is, they should be anchored to observable eondltlona or events 
both antecedent and. subsequent to their mnx postulated occurrence. If, 
for iastance, it is specified that teaching performance shall be judged in 
part on the basis of a task called "creation of a favorable climate r 
learning," then it must be shown (a) that desirable learning outcomes de- 
pend on favorable climate, and Ch) that favorable climate depends on some 
set of teacher behaviors in somis set of clremnstanees. 

When the purpose of the eTraluatlon is teacher certification only , the 
detailed analysis of teaching performance is not essential. The basic 
questions are whether, but net hew, tfie intervention achieves its results, 
fdtether a given performance, or set of performwiees, constitute valid 
evidence that slodlar results will regularly be obtained in the future by 
the individual candidate. Will© the evaluator may use a theory that suh- 
divldes teaching performance (e.g., by specifying "tasks," "strategies, 
"tooves," etc.), he is not compelled to do so. If he does, hwever, he 
BHist cell open his tiieory for a rationale for confining them into a t*ole 
^Icb can be evaluated and used in ^^at Is essentially a "go or no- go" de- 
cision, (ttoittedly^ the decisiem ptoeess can be fractionated^^^to^ 
les of declglons andvearller decisions in the series can be Mde t^tatlve 

and can be used in individual guldLance in a way that may teiper the harsh- 
ness of their here is that the fl^al decisiOT^^ and 

■ logically :^the {'certification' pfress- :itself 

•’ ■■•rhn' and''iffiat{|^^ vplidily pf/'the 'fq^li; for n^ining 
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be bfouglit into question and must be justified.) 

One popular approaeh to evaluation for teacher certlfieation is to es- 
tablish a list of "mintoim competencies" and insist that each is essential 



artfl therefore that certification must be condltl^ed upon demonstration of 
all by the cMidldate. This counts to a requirement that all teachers in 
a given category mast be allhe vith respect to these Mnlma, though not 
necessarily with respect to levels of competency above the minimum nor with 



respect to con^etencies other than those Included in the reference 11s e. 
There can be no doubt that this is a possible procedures but there may be 
soma argtifflent about its desirability. The argmnent in Its favor would ap- 
pear to rest on the assumption that if a teacher Is incompetent In a cer- 



tain area the pupils wJ.H not learn in that area, i.e., that they have no 
alternative to learning by the mediation of that particular teacher. It is 
conceivable, however, that children may learn "on their own" or by way of 
the casual (or planned) totervention of adults other than the teacher to 
^om they are assl^ed (Stephens, 1967). Perhaps they have less need for 
protection from specific areas of incompetence in an Individual teacher 
than fr^ general mediocrity, which eartlflcatlon based on a ehech list of 
minimum eot^etencles woiuld do nothing to prevent. This line of thinking 

miglit lead to the alteriiativc approaeh of setting some mlnimwii level for a 
co^inatlon of eon^etencies, or a sort of index of general eoi^etence, 

wltibut stipuiation as to mdlnlmima levels of specif ie ingted^^^^ 

ponenfc coE^etencles could be measured and reported withOTt being aspd sep- 
arately as criteria for certification, and thijs- school authorities in staff- 
ing could seek a balance in a whole group of teachers hot .required of each 
individual, ■-'■Ihe' very talented person with;-;-^e . or.;x^o';'ireas:'' of,..gla^lng:-:^ 

conq>etence would not -be barred, even -frcmi tei^hing poaicltraa in which , 
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ccrmpetence in those particular areas was ordinarily to be escpeeted, but if 
employed despite the known weaknesses would presumably be assigned in such 
a way that the needs of pupils would be properly provided for. Whatever 
the certification procedures, the rationale on which they are based needs 
to be validated not merely as a possible and plausible one but as a neces- 
sary or definitely beneficial one. To be Justifiable as public policy it 
must demonstrate that it tends to encourage persons with natural or acquired 
proficiencies for teaching to enter the profession, while persuading those 
lacking them and unlikely to acquire them to turn elsewhere. 



4. C ontrol of Extraneous Factors 

Up to this point, we have stressed the importance of locating teaching 
positions within the social-institutional context, of Identifying teaching 



purposes and translating- them into behavlpral objectives so far as reason- 
ably possible, and of applying valid theory to the analysis of teaching 
performance and to the processes of teacher preparation and certification. 
We now must go on to the problems of getting the detailed infommtion the 
evaluator must have about specific instances of teachini perfonnance in 
order to be able to make Judgments or reach conclusions about them. Be- 
cause of the fluidity typical of the. teaching- learaing process, it is a 
long step from merely knowing that it i happening to having systematic ■ 
and pertinent information about it. The evaluator timst resort to careful- 



ly deyisedyprbcedures for observatioh .and instrun^ °- 

the variables defined by the theory he as using.' The topl^^^ Instrmnen- 



tation and the problems of validity associated with it, will be discussed 



■■ ^ inViepWati a ralataCqua6tion>^Ujba;canslda«^ 

: .aV Vwa. •From the Information compiled of contamination from fac- ' • , 







, ■ .. 



comes. 



For instance, If in the performance of a given task from ^ich a 
particular teaching competency is to be inferred certain cues from the 
teacher would normally lead to a given type of pupil response but failed 
to do so because of undetected contrary Influences , the interpretatiori en- 
coded as information might be false. 

In obtaining^ adequate Information for the evaluation of teaching per- 
formance the evaluator has a twofold problem. First, with respect to the 
teaching performance Itself he must identify and sufficiently describe all 
factors likely to have major effects on the learning in question, because 
potent factors, if unrecognized, may easily falsify the inference that 
learning resulted (or failed to result) from the conditions and events ob- 
served. And secondly, he must be equally circumspect about the influences 
upon the pupil performances from which his knowledge about the occurrence 
of learning is derived. In other words, extraneous influences on, the 
teaching- learning process and extraneous Influences on either or both of 
the testings from which data are obtained might contaminate the information 
and hence the evaluation. Tlie known sources of possible contamination can 
often be dealt with in designing the evaluation procedures, and unknown 
ones can be countered by sampling teaching performance generously and aver- 
aging results over a nun4»er of occasions or over many learners. But this 
may be expensive. The smiple size, the sampling procedures, control over 
pupil situational variables to assure eomparable conditions for the pra- 
and post-learning performances, and recognition of interventions other than 
teaching — all are problems of the validity of the data, which are quite dis- 
tinct from, problems of the validity of the theoretical constructs or of the 
teaching purposes previously eonsidered. The problems of data will be re- 
visited in connection with our consideration of instruments for .use in eval- 



uation of teaching performance • 

5 * Exeeutlon 

The practical difficulties in the execution of evaluation procedures 
need not be considered at length here^ as many of them are only too veil 
Imovn and are discussed elsevdiere (Weiner and Hovell^ 1967)# Problerai- 
arising from conflicting purposes must certainly rank at least equal to 
those of limitations of resources* Since teaching performanae is of vital 
concern to so many different people, whose needs and Interests are differ- 
ent, the tendency to prejudge results is a very cmsaon source of practical 
difficulties* 

IV , Related Issues 

Althou^ many issues are related to those that are liiherent in the 
evaluation of teaching performance, we shall consider only a few that are 
currently receiving conslderabla attention by the teaching profession and 
the general public* They arei racial bias in the selection of teachers, 
merit rating as applied to teachers, the accoimtabillty of persons and In- 
stitutions for their educational effectiveness, the pros and cons of new 
practices In differential staffing of the schools, and the Issue of coTrairu- 
nity control of the schools* ' 

1 * Racial bias . 

The social changes of the past: two. decades, and especially the changes 
in the ethnic composition of the population of the large cities of the 
United States reflectihg migration, have accanttiated the problems of racial 
and ethnic in*alances in city school systems that previously existed* 
(Suburban and- rural areas are, of course, not immune, but it is generally 



eonceded that the problem Is presented most acutely in large cities.) In 
particular, the iiiiialance between the racial and ethnic con^osxtion of the 
.teaching staff and that of the pupil population in many or most city 
schools brings to the fore the question of whether the procedures for the 
recruitment of candidates for teacher training and those for te.acher certi- 
fication (or licensure) are frea from racial or ethnic discrimination. It 
can be argued— and is being argued— that existing examination programs, 
which purport to evaluate the candidate's suitability for the teaching pro- 
fessidn on the basis of tests and interviews, effectively exclude mpirijers 
of minority groups whose potential capability as teachers can be demonstra- 
ted. This problem, like others previously considered, can be stated in 
terms of validity, for racial bias— like any other kind of bias— iTi^airs 
the validity of the evaluation In which it occurs. While the old mistakes 
are clear enough, the new ones we may be making as we devise new performance 
based evaluation procedures arc not so readily apparent. Are the competen- 
eles themselves defined in such a way as to reflect values not shared by 
certain minorities In the population? Are the procedures by which they 
may be assessed free from discriminatory provisions? It might be argued 
that perfonnance-based teacher certification Itself would be a remedy for 
racial and ethnic bias in the recruitment and selection processes, but this 
will be true only to the extent that the new set of operations is itself 
untainted. 

2. Merit rating 

An issue of longer standihg than that of racial bias, at least so far 
as nationwide emphasis is concerned, is the question of merit rating. One 
view is that a teacher's retention in en^loynient, acquisition of tenure, 
and salary advancement should be made contingent upbri effective performance 
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as deterraliied by procedures Bpeclfied In some, merit syscem» The various 
piaxis set up lor the detemiiiatxoTi of merxt are^ Iti the pro^eiiltors 

of today’s programs for performance evaluation, and some of the old, argu- 
ments still apply thou^ others are outmoded because of advances in tech- 
nology. Opposition to merit rating In the past has often been able to 
challenge particular plans successfully, precisely on the groxmds of the 
unsoundness of their evaluation processes. Methods of rating teacher eom- 
petenee -were almost routinely found in well-controlled research to be lack- 
jjjg predictive power agalnat criteria of pupil learning. This objection 
will fail once fully valid systems of evaluating over-all teacher competence, 
i.e,, adequate fulfillment of all the essential responsibilities of the posi- 
tion, become established. But other arguments will persist because they 
are based on other grounds, such as the fear that merit rating will create 
a climate of fear and suspicion and thus have an unwholesoma effect on re- 
lationships among teachers, 

3, Accountahlllty . 

Scanewhat related to the issue of merit rating is that of accountablllcy 
for educational results. In one sense It • Is not an Issue, for everyone 
seems to agree that aceountablllt;y per ae is a "good thing," The problems 
arise when one attempts to define who must he held accountable to whom, 
for what, and In ^rtiat mannsr. Since this topic .Is currently receiylng in- 
tensiye consideration elsewhere, .we will merely note, in passing 
the methodology of evaluation of teaching parfcfmance develops, it is likely 
to be snatched up and put to use in more general programs of syste^trtde, 
area-wide, or state-wide evaluatloh now being considered under the i^etus 
Of the interest Ih accoontabillty. 



4. Dl£feren.t:lflX staffing 

An issue cloisely related to the problem of defining various teaching 
positions in terms of Job specif icatlons 'within social- ins t it'utional ^ eon- 
texts, which was discussed earlier, is the now some^at abated controversy 
about differentiated staffing. The concept of Iritroduclng "teacher aides" 
into the school staffing pattern was put forward with s'ome fanfare by the 
Ford Foundation’s Fund for the Advancement of Education in the early ISSO'sk 
Almost at once there was extensive opposition to the idea, based largely on 
some of the conditions, such as increased class size, that were associated 
it in the early experiments. Since that time the use of various hinds 
of school aides, teacher aides, educational assistants, etc,, often grouped 
under the generic term paraiorofessionals , has increased rapidly and some 
of the controversy has subsided, though the issues have not necessarily 
been resolved. Since the newer patterns of differentiated staffing involve 
questions of preparation for and societal legitimization of the new posi- 
tions and also the possibility of progresslpn from paraprofessional to pro- 
fessional responsibilities (the "career ladder" concept), they cannot help 
affecting and being affected by developntents in the area of evaluation of 
teaching performance, 

5, Coimituhity control of schools 

The final issue to he mentioned briefly here is that of connnunity con- 
trol of the schools. Sometimes tMs appears in the form of controversy 

ovex" ^ plan of daceTitrallzat:iorip as It "has in Hew Yo^k City. SoniefclTiies It 
relates mainly to quastions of representation on boards of eduoation, and 
nearly always it involves mnority group interests and values. Its relevance 
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to tgvaluation of teaching performance is identical with ita relevance 
all aspects of evaluation; almost axicrmtlcally any shift in the pvoces- 
ses of social control and in the balance of representation within the 
structures where control . is escerclsed entails corresponding shifts in pur*^ 
poses, T^ieh are the foundation upon which all evaluations are built,, Fnt' 
therfore, changes in control almost inevitahly affect the mechanisnis of 
evaluation, its instrnmentalitias, procedures, and technology, because the 
latter are' dependent to a considerahle extent on the various sef^ tejbT 
lations and understandings through ^^ic]ti general control j-s maintained, - • 
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